Architecture Optimization Model for the Multilayer Perceptron and Clustering
نویسنده
چکیده
This paper presents an approach called Architecture Optimization Model for the multilayer Perceptron. This approach permits to optimize the architectures for the multilayer Perceptron. The results obtained by the neural networks are dependent on their parameters. The architecture has a great impact on the convergence of the neural networks. More precisely, the choice of neurons in each hidden layer, the number of hidden layers and the initial weights has a great impact on the convergence of learning methods. In this respect, we model this choice problem of neural architecture in terms of a mixed-integer problem with linear constraints. We propose the genetic algorithm to solve the obtained model. The experimental work for classification problems illustrates the advantages of our approach.
منابع مشابه
Prediction of daily evaporation using hybrid support vector regression-firefly optimization algorithm and multilayer perceptron
Prediction of daily evaporation is a valuable and determinant tool in sustainable agriculture and hydrological issues, especially in the design and management of water resources systems. Therefore, in this study, the ability of artificial intelligence models of multi-layer perceptron (MLP), support vector regression (SVR), and the hybrid model of support vector regression-firefly optimization a...
متن کاملPrediction-Based Portfolio Optimization Model for Iran’s Oil Dependent Stocks Using Data Mining Methods
This study applied a prediction-based portfolio optimization model to explore the results of portfolio predicament in the Tehran Stock Exchange. To this aim, first, the data mining approach was used to predict the petroleum products and chemical industry using clustering stock market data. Then, some effective factors, such as crude oil price, exchange rate, global interest rate, gold price, an...
متن کاملComparing Hybrid Systems to Design and Optimize Artificial Neural Networks
In this paper we conduct a comparative study between hybrid methods to optimize multilayer perceptrons: a model that optimizes the architecture and initial weights of multilayer perceptrons; a parallel approach to optimize the architecture and initial weights of multilayer perceptrons; a method that searches for the parameters of the training algorithm, and an approach for cooperative co-evolut...
متن کاملTowards a constructive multilayer perceptron for regression task using non-parametric clustering. A case study of Photo-Z redshift reconstruction
The choice of architecture of artificial neuron network (ANN) is still a challenging task that users face every time. It greatly affects the accuracy of the built network. In fact there is no optimal method that is applicable to various implementations at the same time. In this paper we propose a method to construct ANN based on clustering, that resolves the problems of random and ad’hoc approa...
متن کامل